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IN RE APPLICATION OF : 

JEAN- JACQUES FAVOT ET AL : ATTN: APPLICATION DIVISION 

SERIAL NO: NEW U.S. PCT APPLN : 
(Based on PCT/FR00/01232 

FILED: HEREWITH : 

FOR: SYSTEM FOR PROCES SING 
DATA FOR DISPLAY ON A 
MATRIX SCREEN 

PRET.TMTNARY AMENDMENT 

ASSISTANT COMMISSIONER FOR PATENTS 
WASHINGTON, D.C. 20231 

SIR: 

Prior to a first examination on the merits, please amend the above-identified 
application as follows: 

TN THR SPECIFICATION 

Page 2, beginning at line 17, bridging page 3, line 1, please delete the paragraph and 
replace it with the following paragraph: 

In the patent filed on 28 August 1987 under No. 87 12 039 and granted on 29 April 
1994 under No. 2 619 982, corresponding to U.S. 5,150,105, the company THOMSON-CSF 
proposed a solution to this problem, consisting in using a set of subpixels, dubbed a 
microregion as it is widely known, to represent each dot. The distribution of the luminances 
and chrominances of the subpixels within these microregions obeys a law which is variable as 
a function of the result to be obtained and which makes it possible to alleviate the various 



drawbacks mentioned above. For example the representation of a stroke will correspond to a 
distribution of the luminance having the shape of a Gaussian in a direction transverse to this 
stroke, and this will give the desired thickness for good visibility and will "erase" the 
staircase effects. Numerous distribution laws which make it possible to tackle most of the 
situations encountered are currently known. In this basic patent, the processing 
corresponding to the use of these microregions, often referred to as filtering, is performed in a 
processing unit known as a "UMIP", standing for microregion unit, placed between the pixel 
memory and the matrix screen. This implies that the digital processing is performed on all 
the pixels, thus requiring particularly considerable computational power. 

Page 3, at lines 4-17, please delete the paragraph and replace it with the following 
paragraph; 

In a French patent application filed on 23 August 1990 under No. 90 10587, published 
on 3 February 1995 under No. 2 666 165, and granted via the European channel on 26 April 
1995 under No. 0472463, and corresponding to U.S. 5,287,451, the company SEXTANT 
Avionique proposed that the processing defining the microregions be performed by placing 
the UMIP performing this processing ahead of the image memory. The throughput of the 
processing in this UMIP is thus much lower, since it corresponds only to the dot actually 
displayed, but on the other hand the size of the image memory must be much larger, since it 
is necessary to store n times the set of pixels of the screen, n being equal to the number of 
pixels contained in a microregion. 



I N THE CLAIMS 
Please cancel Claims 1-4 without prejudice. 
Please add new Claims 5-14 as follows: 



5. (New) System for displaying an image on a screen formed of a matrix of pixels 
each including a given number of subpixels with primary colors, comprising a symbol 
generator which delivers information characteristic of dots of the image to be displayed and is 
connected to an image memory which is itself connected to a correlator, the correlator 
configured to determine a luminous level of each pixel or subpixel of the screen by a 
processing using a filter, dubbed microregion, comprising a given number PxQ of luminous 
weighting coefficients applied to a set of PxQ pixels of subpixels around said pixel or 
subpixel to be processed, wherein 

the image memory is organized to allow reading of n pixel or subpixels in parallel, n 
greater or equal to two, 

the correlator comprises a luminance path which performs a synchronous processing 
in parallel of the luminous levels of the n pixels or subpixels by selecting a microregion, for 
each pixel or subpixel, and by combining, at a given instant, the luminous weighting 
coefficients of the n microregions selected for each of the n pixels or subpixels, with the 
coefficients already contained in the correlator and originating from successive correlations 
of the coefficients of all the microregions previously selected. 

6. (New) System according to Claim 5, wherein the selecting of a microregion, for 
each pixel or subpixel, is undertaken as a function of the position determined by the generator 
of the dot of the image to be displayed in the pixel or subpixel. 

7. (New) System according to Claim 5, wherein the symbol generator determines a 
color of the dot of the image to be represented in a form of a color code and generates an 
attribute making it possible to attribute the color to a stroke element or to a background 
element, and the correlator furthermore comprises a stroke color path and a background color 
path, allowing the synchronous and simultaneous processing of the color of the n pixels or 



subpixels either by the stroke color path, or by the background color path, as a function of the 
attribute. 

8. (New) System according to Claim 7, wherein the stroke color path is connected to 
the luminance path in such a way as to manage intersections and superpositions of strokes of 
different colors, as a function of predetermined color priority codes. 

9. (New) System according to claim 5, wherein the luminance path and chrominance 
path of the correlator are formed by a union of independent lines, and a link between the lines 
for taking into account relations between the pixels or subpixels in a vertical direction is 
effected by reinjecting into a given line content of data emanating from an adjacent line. 

10. (New) System according to Claim 7, wherein the correlator further comprises a 
stroke color generator and a background color generator configured to transform the colors of 
the stroke color path and of the background color path, delivered in a form of codes, into red, 
green, blue intensity levels, and a mixer for combining in parallel for the n pixels or subpixels 
to be processed, the outgoing data of the luminance path, of the stroke color generator, of the 
background color generator, to construct pixels or subpixels actually intended for display in 
the matrix display. 

11. (New) System according to Claim 10, wherein the mixer comprises a first 
function of performing for the n pixels or subpixels products of brightness levels emanating 
from the luminance correlator times the red, green, blue intensity levels. 

12. (New) System according to Claim 1 1, wherein the mixer comprises a second 
function of managing for the n pixels or subpixels inlaying of stroke elements into a 
background of a same color by performing an outlining function. 



13. (New) System according to claim 5 for the parallel processing of two pixels or 
subpixels, wherein the processing uses 16 microregions corresponding to a processing whose 
fineness is a quarter of a pixel. 

14. (New) System according to Claim 13, wherein each microregion comprises 4X4 
coefficients and each coefficient exhibits 8 possible luminous levels. 



IN THE ABSTRACT OF THE DISCLOSURE 
Please cancel the Abstract page 22 in its entirety and insert the following new 
Abstract therefor: 



ABSTRACT OF THE DISCLOSURE 
System for processing data for display on a matrix screen. The system uses an image 
memory in which n pixels are read in parallel so as subsequently to be able to process them in 
parallel in a microregion unit. That makes it possible to retain an image memory of 
reasonable size while limiting the throughput of the microregion unit. 



RE M ARKS 

Favorable consideration of this application, as presently amended, is respectfully 
requested. 

The present Preliminary Amendment is submitted to place the above-identified 
application in more proper format under United States practice. By the present Preliminary 
Amendment the specification has been amended to update the U.S. patent status of certain 
references recited in the background section. 

Original Claims 1-4 are cancelled and new Claims 5-14 are presented for 
examination. New Claims 5-14 are deemed to be self-evident from the original disclosure, 
including original Claims 1-4, and thus are not deemed to raise any issues of new matter. 
Any differences between new Claims 5-14 and original Claims 1-4 are deemed to at most 
broaden the scope of new Claims 5-14. 

A new Abstract believed to be in more proper format under United States practice is 
also submitted herein. 



The present application is believed to be in condition for a full and thorough 
examination on the merits. An early and favorable consideration of the present application 
is hereby respectfully requested. 

Respectfully submitted, 

OBLON, SPIVAK, McCLELLAND, 
MAIER & NEUSTADT, P.C. 
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Amendment Filed on: 

TN THE SPF.nrFTP A TTQM 
Page 2, beginning at line 17, bridging page 3, line 1, please delete the paragraph and 
replace it with the following paragraph: 

--In the patent filed on 28 August 1987 under No. 87 12 039 and granted on 29 April 
O 1994 ^der No - 2 619 982, corresponding to T T S S I SO 1 OS the company THOMSON-CSF 
;0 proposed a solution to this problem, consisting in using a set of subpixels, dubbed a 
|j microregion as it is widely known, to represent each dot. The distribution of the luminances 
\jj and chrominances of the subpixels within these microregions obeys a law which is variable as 
H a function of the result to be obtained and which makes it possible to alleviate the various 
J* drawbacks mentioned above. For example the representation of a stroke will correspond to a 
CI distribution of the luminance having the shape of a Gaussian in a direction transverse to this 
stroke, and this will give the desired thickness for good visibility and will "erase" the 
staircase effects. Numerous distribution laws which make it possible to tackle most of the 
situations encountered are currently known. In this basic patent, the processing 
corresponding to the use of these microregions, often referred to as filtering, is performed in a 
processing unit known as a "UMIP", standing for microregion unit, placed between the pixel 
memory and the matrix screen. This implies that the digital processing is performed on all 
the pixels, thus requiring particularly considerable computational power. 



-9- 



Page 3, at lines 4-17, please delete the paragraph and replace it with the following 
paragraph: 

In a French patent application filed on 23 August 1990 under No. 90 10587, published 
on 3 February 1995 under No. 2 666 165, and granted via the European channel on 
[26.04.1995] 26 April 1995 under No. 0472463, and corresp onding to u.K 5,?S7 451 the 
company SEXTANT Avionique proposed that the processing defining the microregions be 
performed by placing the UMIP performing this processing ahead of the image memory. The 
throughput of the processing in this UMIP is thus much lower, since it corresponds only to 
the dot actually displayed, but on the other hand the size of the image memory must be much 
larger, since it is necessary to store n times the set of pixels of the screen, n being equal to the 
number of pixels contained in a microregion. 

INTHF.f!T.ATMS 

Claims 1-4 (Canceled). 
Claims 5-14 (New).— 

fNT THF, ARSTR APT 

(New). 
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SYSTEM FOR PROCESSING DATA FOR DISPLAY ON A 
MATRIX SCREEN 

The present invention relates to a system for 
processing data for display on a matrix screen. It 
applies more particularly to the displaying on a liquid 
crystal screen of the symbolic representations relating 
to the parameters for aiding the piloting and 
navigation of an aircraft. 



The various mechanical or electromechanical instruments 
intended for advising the pilot of an aircraft as to 
the behaviour of the latter, its position in space, the 
course to be followed, engine monitoring etc. ; have 
15 long since been begun to be replaced by visualization 
systems on which these indications are displayed in a 
synthetic manner. In particular, this allows progress 
towards ever more symbolic representation of these 
various parameters, thus affording the pilot a much 
2 0 more vivid and hence much more directly meaningful 
representation of the situation encountered. The 
hardware used initially comprised cathode-ray tubes on 
yj which the display was undertaken in so-called "bird's 

Y eye" mode. Technical progress has led to the 

2 5 replacement of these tubes by flat screens, generally 

liquid crystal screens, the matrix control of which 
imposes "television" scan type pictorialization . 
furthermore these liquid crystal screens allow colour 
visualization, which is universally used nowadays and 

3 0 which requires a particular addressing of the primary 

colour subpixels forming the coloured pixels proper. 



The digital processing of the various data originating 
from the sensors, making it possible to define the 
3 5 symbols displayed on the screen, quite naturally leads 
to the obtaining of display data in a vector form which 
is particularly suited to "bird's eye" scanning. 
Television scanning is achieved in a well known manner 
by determining in a processor the values of the 



luminance and of the chrominance of each pixel of the 
matrixwise controlled screen. These values are stored 
in a random access memory, so as to follow the data 
stream corresponding to the bird's eye display. This 
memory is subsequently read sequentially to achieve 
television display. In fact, two memories are used, 
written and then read alternately so as to ease their 
management . 

The transformation system thus briefly described 
exhibits various drawbacks. More particularly the 
strokes represented by alignments of pixels are too 
small to be viewed properly, the oblique strokes form 
staircases, and the colours at the points where several 
strokes cross blend to give false colours. 

In a patent filed on 28 August 1987 under No. 87 12 039 
and granted on 29 April 1994 under No. 2 619 982, the 
company THOMSON-CSF proposed a solution to this 
problem, consisting in using a set of subpixels, dubbed 
a microregion as it is widely known, to represent each 
dot. The distribution of the luminances and 
chrominances of the subpixels within these microregions 
obeys a law which is variable as a function of the 
result to be obtained and which makes it possible to 
alleviate the various drawbacks mentioned above. For 
example the representation of a stroke will correspond 
to a distribution of the luminance having the shape of 
a Gaussian in a direction transverse to this stroke, 
and this will give the desired thickness for good 
visibility and will "erase" the staircase effects. 
Numerous distribution laws which make it possible to 
tackle most of the situations encountered are currently 
known. In this basic patent, the processing 
corresponding to the use of these microregions, often 
referred to as filtering, is performed in a processing 
unit known as a "UMIP" , standing for microregion unit, 
placed between the pixel memory and the matrix screen. 
This implies that the digital processing is performed 



on all the pixels, thus requiring particularly 
considerable computational power. 

In a French patent application filed on 23 August 1990 
5 under No. 90 10587, published on 3 February 1995 under 
No. 2 666 165, and granted via the European channel on 
2 6.04.1995 under No. 0472463, the company SEXTANT 
Avionique proposed that the processing defining the 
microregions be performed by placing the UMIP 
10 performing this processing ahead of the image memory. 
The throughput of the processing in this UMIP is thus 
much lower, since it corresponds only to the dot 
actually displayed, but on the other hand the size of 
the image memory must be much larger, since it is 
15 necessary to store n times the set of pixels of the 
ifl screen, n being equal to the number of pixels contained 

^ in a microregion. 

# It will be noted in passing that all these systems, 

^ 2 0 both those of the prior art and that of the invention, 

H apply equally to the processing of pixels as to that of 

rr subpixels . The choice between the processing level is 

yj made essentially as a function of the nature of the 

display screen used, which may allow either global 
25 processing as in the case of "STRIPE" type displays, or 
which requires processing at the subpixel level as in 
the case of "QUAD" type displays. 
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Therefore, in the standard case of a microregion 
3 0 composed of 4x4 = 16 pixels the volume of the memory is 
multiplied by 16. Such a memory is technically 
realizable but it has a prohibitive volume and a 
prohibitive cost. 

3 5 In a patent application filed on 21 December 1995 under 
No. 95 15 261 and granted on 6 February 19 9 8 under 
No. 2 742 899, the company SEXTANT Avionique proposed 
an improvement to the previous system consisting in 
inserting between the UMIP and the image memory a 



device substantially equivalent to a cache memory, 
which makes it possible to limit the matrix aspect due 
to the microregions to a single dimension, transverse 
or vertical. The volume of the image memory is thus 
partially limited, but one introduces the need to empty 
the cache memory regularly when it is full, this 
requiring that the processing be stopped during this 
time and entailing a reduction in the processing 
capacity of the graphics generator. 

To alleviate these drawbacks, the invention proposes a 
system for processing data for display on a matrix 
screen, of the type comprising a symbol generator 
connected to an image memory itself connected to a 
correlator making it possible to implement a processing 
based on microregions so as to generate the final image 
to be displayed on a matrix screen, mainly 
characterized in that the image memory is organized so 
as to be able to read n pixels in parallel and in that 
the correlator is organized so as to process these n 
pixels in parallel. 

According to another characteristic, the correlator is 
divided into two parts making it possible to process 
the luminance and the chrominance separately so as to 
make it possible to perform a hierarchical processing 
of the colours . 

According to another characteristic, it comprises means 
for separately processing the colour of the strokes and 
the colour of the background, and a mixer for making it 
possible to outline the elements of scenery displayed 
on the background in tone on tone mode. 

According to another characteristic, the correlator is 
organized in m substantially identical parallel lines 
making it possible for the m pixels of one of the axes 
of the microregions used to be processed in parallel. 



Other features and advantages of the invention will 
become clearly apparent in the following description 
presented by way of nonlimiting example with regard to 
the appended figures which represent: 

5 

Figure 1, a general schematic diagram of the 
system according to the invention; 
Figure 2, the timing diagram for the operation 
of a system according to the invention; 
10 - Figure 3, a schematic diagram of a correlator 

intended for a system according to the 
invention; 

Figure 4, an example of tables of filters 
intended to be implemented in a system 
15 according to the invention, 

Figure 5, a detailed schematic diagram of a 
subset of the correlator 3 03 of Figure 3; 
Figures 6a and 6b, a complete schematic diagram 
of this same correlator; 

2 0 - Figures 7 and 8, illustrations of the luminance 

chrominance product at the output of the system 
according to the invention; and 

Figure 9, a schematic diagram of a mixer making 
it possible to perform the processing 
25 illustrated in Figures 7 and 8. 

The invention therefore proposes to place the UMIP 
between the image memory and the matrix screen, this 
corresponding to the basic structure described in the 

3 0 first patent cited above. The volume of the memory is 

then strictly limited to the quantity required to 
represent the set of pixels and subpixels of this 
matrix screen, thereby very substantially limiting the 
volume and cost thereof. To be able nevertheless to 
3 5 obtain the high capacity to draw tracks with a 
sufficiently small throughput, the processing between 
the memory and the UMIP is performed in parallel on n 
pixels or subpixels. The number of dots processed per 
cycle is thus multiplied by n and the throughput of the 



y 15 This system therefore comprises a symbol generator 101, 

ifs known in the art, which makes it possible to obtain the 

^ values of the positions and of the chrominances of the 

HI 

f ?? various subpixels intended to represent the symbols 

# which will ultimately be displayed on a display screen 

y 2 0 102 of the LCD type. 



U 
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UMIP, for the same display capacity, is itself 
multiplied by n. 

In the exemplary embodiment described below, we confine 
5 ourselves to a device making it possible to process the 
subpixels of the display two by two using microregions 
of size 4 by 4. This example corresponds to standard 
practice with regard to the size of the microregions, 
in conjunction with the use of a QUAD type display, 
10 which imposes processing at the subpixel level. 

Represented in Figure 1 is a general schematic of a 
system according to the invention. 



The data thus obtained from the generator 101 are 
yj stored in an image memory 103 . This memory is of the 

double page type, ,each page of which possesses a 
25 capacity at least equal to the number of subpixels of 
the display 102. 

This double-page organization makes it possible, in a 
known manner, to simultaneously write to a page from 
3 0 the symbol generator and read from the other page for 
transmission to the display via processing means of the 
UMIP type 104. 

According to the invention, the memory 103 is 
3 5 furthermore organized in such a way as to allow 
simultaneous reading of two subpixels in parallel, it 
being possible to do this without any particular 
problem with the means known in the art. 
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i The UMIP 104 comprises on the one hand a correlator 105 

having two paths in parallel and on the other hand a 
sequencer 106. 

5 This sequencer makes it possible to manage the 
registering in the memory 103 of the information 
originating from the symbol generator 101, and on the 
other hand to synchronize the reading of this memory 
with the processing in the correlator, as well as the 
10 displaying on the screen 102 of the subpixels thus 
processed. This sequencing is performed according to a 
timing diagram which is illustrated in Figure 2 . The 
synchronization signal is provided simultaneously to 
^ the symbol generator 101, to the image memory 103, to 

f |l 15 the correlator 105 and to the display 102 . 

jjl By way of example/ the real-time cycle running between 

two synchronization pulses lasts 16 ms . 

h 20 This sequencer is formed of a set of logic circuits 

> operating on the basis of a clock and which are 

connected so as to deliver, according to Boolean logic 



for example, the signals required by the various 
entities to which the sequencer is linked. To obtain 
25 the most compact set possible, the sequencer is 
preferably installed in a known manner in a circuit of 
the FPGA type. 



According to the invention, the correlator 105 allows 
3 0 the parallel processing of two dots with microregions 
of size 4x4. This makes it possible to obtain real-time 
processing corresponding to the rate of display of the 
subpixels in the display 102. 

3 5 The position, determined by the generator 101, in the 
subpixel of the dot to be displayed makes it possible 
to determine the filter (type, or profile, of the 
microregion) to be used to move the luminous dot in 
this subpixel in such a way as to obtain the desired 
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effect. To do this, 16 different filters are used, 
thereby allowing processing whose fineness is 1/4 of a 
subpixel. The operations for processing the luminance 
and the chrominance are separate. Colour codes are used 
5 to represent the chrominance, this making it possible 
to manage a priority between these colours when the 
tracks of two symbols overlap, by displaying for 
example a red dot at the crossover of a red line and a 
blue line. 

10 

Furthermore, to be able to make it possible to 
distinguish symbols whose colour is the same as that of 
the background, for example a white line on a white 
background, the correlator performs an outlining of the 
43 15 patterns, consisting for example in edging this white 

line with two fine black lines. 

f v 

;r J Represented in Figure 3 is a schematic diagram of the 

\l correlator 105. 

* 2 0 

I** 

y k The latter receives as input the values of the 

positions and of the colours (chrominances) of the two 
2j subpixels 1 and 2 read in parallel from the memory 103 . 

|«& The values of the positions are applied to two 

2 5 identical tables 3 01 and 3 02, which contain the values 

of 16 filters (microregions ) used. The values of these 
filters have been determined, either experimentally or 
by calculation, so as each to correspond to an offset 
between the position of the physical subpixel and that 
30 of the subpixel drawn, as explained above. For each 
subpixel, a filter is therefore selected respectively 
from each table. 

Each of these filters contains luminous weighting 

3 5 coefficients of the 4x4 subpixels which make up the 

microregion corresponding to the filter. In the 
exemplary embodiment described this number of luminous 
levels is limited to 8, this being entirely adequate as 
experience shows. Hence, for each incoming subpixel, 
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the tables of filters 301 and 302 each make it possible 
to obtain 16 coefficients of luminous levels each 
corresponding to one of the subpixels of the 
microregion . 

5 

By way of example, represented in Figure 4 is a table 
of 16 filters each of which is selected as a function 
of the shifts dx and dy of the subpixel with respect to 
the luminous centre of the microregion. 

10 

These coefficients are then applied to a luminance 
correlator 3 03 which will be described later. The 
values of the colours of the subpixels 1 and 2 are for 
their part applied to a chrominance correlator 3 04, 
15 itself described later. 

The data originating from this chrominance correlator 
are then applied on the one hand to a stroke colour 
generator 3 05 and on the other hand to a background 
20 colour generator 306, themselves also described later. 

Finally, the outgoing data from the luminance 
correlator 3 03 and from the two colour generators 3 05 
and 306 are applied to a mixer 307, itself described 
25 later, which ultimately delivers the actual values of 
the subpixels 1 and 2 to be displayed in the matrix 
screen 102 to obtain the visualization effect. 

The luminance and chrominance correlators 3 03 and 3 04 
3 0 are formed by the union of independent and generic 
subsets whose number is equal to that of the subpixels 
contained in the vertical dimension of the 
microregions . Subsequently in this text we shall refer 
to these subsets as xv lines" since they serve to process 
3 5 the successive subpixels of a display line of the 
matrix display. 

The link between these various lines for taking into 
account the relations between the subpixels of the 



microregions in the vertical direction is effected by 
way of FIFO type memories placed at the output of the 
lines and which reinject the content of the outputs 
into the lines. This aspect of the correlators will be 
described in relation to the complete schematic 
represented in Figure 6 . 

Represented in Figure 5 is the schematic of one of 
these lines, comprising a correlator for the luminance 
and a correlator for the chrominance. These correlators 
essentially use logic functions of the OR, SUP and 
SUP/ECR type. These functions will be described 
subsequently in this text. This diagram also comprises 
D-type flip-flops 504, the well-known role of which is 
essentially to ensure the link between the other 
entities while simultaneously affording a memory effect 
and a delay effect so as to comply with the sequencing 
required for overall operation. In this schematic 
diagram, on each occasion just one D-type flip-flop has 
been represented for the understanding of the manner of 
operation but there will if required be the necessary 
number thereof in series so as to obtain proper 
sequencing . 

The luminance correlator thus embodied makes it 
possible at an instant T to combine the coefficients of 
two new incoming microregions with the coefficients 
already contained in the correlator and which originate 
from the successive correlations of the coefficients of 
all the previous microregions. The values of the 
coefficients of the microregions immediately preceding 
those incoming will in the general case be predominant 
but, as in any correlation, the coefficients of the 
earlier microregions will have some effect which will 
wane as they become more remote in time. 

The luminance correlator embodied according to this 
diagram makes it possible to obtain a smoothing effect 
on the actor elements of the image (the strokes) which 
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pass through it. On the other hand in this exemplary 
embodiment the scenery elements of the image (the 
background) are not smoothed and hence do not pass 
through the luminance correlator. It would nevertheless 
be possible, by way of a variant embodiment, to use a 
second luminance correlator to smooth the elements of 
the scenery also. 

The chrominance correlator, as embodied in this 
exemplary embodiment, comprises two paths which allow 
independent processing of the actor elements of the 
image and the background scenery elements, as defined 
above. To do this, each incoming subpixel comprises an 
attribute, generated at the level of the symbol 
generator 101, which makes it possible to route the 
corresponding information towards the stroke path or 
towards the background path. This attribute also makes 
it possible to route the subpixels corresponding to the 
scenery elements towards the luminance path. 

The data corresponding to the colours, computed in the 
symbol generator, are so in the form of colour codes 
which are hierarchized . This makes it possible to 
obtain priority in ^the display of certain colours, so 
as on the one hand not to have a blend of colours 
giving an erratic result, and on the other hand to 
allow through certain priority information. In this 
regard reference may be made to the example given above 
of the crossing of a red stroke and a blue stroke. For 
this, the stroke colour path is connected to the 
luminance path in such a way as to correctly manage the 
intersections and the superpositions of strokes of 
different colours, which therefore comprise different 
levels of priorities on display. This hierarchy is 
obtained in the diagram with the aid of the SUP 
functions, which are hard-wired in such a way that 
after correlation only the high-order codes 
corresponding to the priority colours are preserved. 
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In the example described, the background path merely 
duplicates the colour codes entering by way of 
the OR function 501. It therefore does not make it 
possible to deal with the problem of the superposition 
5 of two different colours for the background. This 
corresponds to a simplification which is justified by 
the fact that in the modes of display used hitherto 
this kind of conflict does not exist. For this problem 
to be dealt with in the future, it would be entirely 
10 possible to use, as for the stroke path, SUP functions 
to make it possible to manage the hierarchy between 
these colours. This hierarchy would itself be obtained 
with the aid of the colour codes as for the stroke 
path. 

CI 

'IS The action of the colour correlators is to thicken the 

^ theoretical track with a square profile of width equal 

to the width of the microregions, that is to say 4 
subpixels in the exemplary embodiment described. To do 
20 this, two subpixels are processed simultaneously by 
p injecting the respective coefficients of the associated 

y-v microregions into the interlaced structure of the two 

channels of the correlators. The processing is 

PI 

synchronous, that is . to say that at each clock edge the 
25 coefficients propagate from cell to cell so as to 
undergo the correlations. The D-type flip-flops are 
used to perform this propagation. The correlation with 
the results of the correlations performed on the 
previous lines is performed at the level of the last 
3 0 cells of the correlators, which receive, via return 
paths originating from FIFO memories loaded with these 
previous results, the coefficients corresponding to 
these results . 



3 5 The SUP/ECR function is a complex logic function which 
possesses 3 coefficient inputs, which will be denoted 
A , B and C, 2 control inputs, denoted E and ABC, and an 
output denoted S. It is carried out by the conventional 
means of combinatorial analysis, in such a way as to 
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perform the functions corresponding to the following 
truth table : 



£ 


ABC 


S 


Comments 


1 


1 


c 


C overwrites A and B 


1 


2 


B 


B overwrites A and C 


1 


4 


A 


A overwrites B and C 


0 


3 


sup (B, C) 


retain the larger of B or C 


0 


5 


sup(A,C) 


retain the larger of A or C 


0 


6 


sup (A, B) 


retain the larger of A or B 


0 


7 


sup ( A , B , C ) 


retain the largest of A, B or C 



This SUP/ECR function is used in the luminance 
correlator to combine luminous levels on the basis of 
the two control inputs which receive as drive signals 
those originating from the corresponding outputs of the 
SUP functions. 



The SUP function is used in the chrominance correlator 
to combine colour codes . 

It comprises three inputs intended for the 
coefficients, which will be denoted A, B and C, and 
three outputs, denoted S, E and ABC, intended to be 
connected to the corresponding inputs of the SUP/ECR 
functions described above. It too is carried out 
according to the conventional methods of combinatorial 
analysis so that the values of the outputs as a 
function of the values of the coefficients: input 
comply with the following truth table: 



Luminance coef f . 


E 


ABC 


S 


Comments 


A>B and C 


1 


4 


A 


overwriting by A 


B>A and C 


1 


2 


B 


overwriting by B 


C>A and B 


1 


1 


C 


overwriting by C 


A=C>B 


0 


5 


A 


blend A and C 


A=B>C 


0 


6 


A 


blend A and B 


B=C>A 


0 


3 


B 


blend B and C 


A=B=C 


0 


7 


A 


blend A, B and C 
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In the example described the complete correlator, 
represented in Figure 6, comprises four lines. 

As was explained above, to obtain the desired 
correlation the output of each line is reinjected onto 
the last stage of the previous line with the aid of 
FIFO type memory 601. Thus line 4 feeds line 3, line 3 
line 2 and line 2 line 1. 

The output of line 1 is therefore that of the 
correlator itself, which determines the luminance and 
the chrominance of the subpixels 1 and 2. 

For the luminance the value obtained has to be 
multiplied by a fixed factor so as to adapt it to the 
dynamic range of the display used. This is carried out 
in the mixer 604. 

For the chrominance on the other hand, since only 
colour codes are available, it is necessary to 
transform them into levels of intensity for each 
primary component , red, green and blue . These colour 
codes are therefore transformed in a stroke colour 
generator 602 on the one hand and a background colour 
generator 603 on the other hand into three colour 
levels, for each primary colour. The number of these 
levels as well as their distribution is adapted to the 
type of display used, according to a known method. 

When us ing a di splay o f known QUAD type for example , 
with as in the exemplary embodiment described in this 
text, operation at subpixel level, each outgoing colour 
code is transformed into a single primary colour as a 
function of its position in the output stream. In this 
way different intensity levels can be assigned to each 
of the two green subpixels of the QUAD pixel. 

Ultimately the outgoing data from the correlator 
corresponding to the luminance, to the stroke colour 
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and the background colour of the two pixels, are 
combined in a mixer 604 which makes it possible to 
construct the subpixels actually intended for display 
in the matrix display. It can carry out two distinct 
functions . 

A first function consists in performing the luminance 
times chrominance product so as to obtain inside an 
object of specified colour the intensity profile of the 
colour required . 

Thus, as represented in Figure 7 , by taking for example 
a cross section through a stroke displayed with a 
specified colour, the colour information exhibits a 
rectangular shape 701 in this section, and the 
luminance a Gaussian shape 702. It will be noted that 
it is indeed this Gaussian shape which is 
characteristic of the processing by microregions . The 
product of the luminance times the colour gives a 
coloured Gaussian- shaped section 703, which does indeed 
correspond to what is desired, that is to say a colour 
whose intensity rises progressively from the edges of 
the stroke to its centre, subsequently falling 
symmetrically on the other side. This does indeed 
correspond to the thickening of the stroke so as to 
make it more visible, with blurring on its edges making 
it possible among other things to erase the staircase 
effects . 

The second function of the mixer consists in managing 
the inlaying of the image elements into the background, 
by performing an outlining function, in particular in 
the case cited above where it is necessary to display a 
colour tone on tone, by causing for example a white 
line to stand out against a white background. 

To do this, as represented in Figure 8, the mixer 
performs the product of the background times the image. 
The background is represented here by a rectangle 8 01 



10 
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which is slightly wider than the image element 802. The 
outlined image 803 is obtained, in which it is indeed 
seen that the image proper, which is of the same colour 
as the background, comprises a Gaussian- shaped profile 
which terminates in two black troughs which outline the 
image with respect to the remainder of the background, 
whose level may be substantially the same as that of 
the Gaussian. 

Since two subpixels are processed simultaneously, two 
identical and independent mixers which each operate in 
parallel will be used in the exemplary embodiment 
described here of the invention. 

15 Represented in Figure 9 is a schematic diagram of an 
exemplary embodiment of such a mixer. 

The luminance information and stroke colour information 
are applied to linearizing circuits 901, intended to 
2 0 compensate for the nonlinear response of the matrix 
display, more particularly in the case of LCD type 
displays . 

The product of these luminance data and stroke colour 
25 data is obtained via the function Min 902. This 
function ensures that only the smallest data of the two 
paths are retained. This ensures that the subpixel will 
be blanked out if it does not correspond to the colour 
required and ensures a correct luminance level as a 
function of the luminance profile of the level fixed by 
the primary colour. 

The display is thus saturated so as always to have a 
very visible image. 

The two items of information are then applied to a 
multiplexer 903 controlled by the output of the MIN 
circuit. It delivers the stroke luminance information 



30 



35 
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LT for a subpixel belonging to the ridge of the 
smoothed stroke. 

The background colour information is likewise applied 
to a linearizing circuit which makes it possible to 
obtain the background luminance LF , for a pixel 
belonging to an element of the background. 

Finally, an averaging circuit 904, which receives both 
LT and LF, makes it possible to obtain an average 
luminance between that of the background and that of 
the stroke, for a pixel belonging to the superposition 
between the stroke and the background. 

These three values are applied to a multiplexer 9 05 
which is controlled by a selector 906. For this purpose 
this selector, which operates according to the rules of 
combinatorial analysis, applies the rules of the 
following truth table, in which LS is the outgoing 
luminance level from the correlator, al is a threshold 
fixed as a function of the content of the table of 
filters used in such a way that the central pixels of 
the microregions have priority in display so that the 
stroke may always be. seen, and a2 is a threshold fixed 
in such a way that the inlaying of a stroke on a low 
level background preserves an optimal smoothing level 
so as to be able to preserve the profile of the stroke: 





Background Lum. 


MUX 


Pixel 


= 0 


LF 


0 


LF 


>ccl 


X 


2 


LT 


X 


<oc2 


2 


LT 


>0 and <al 


>(X2 


1 


average (LT, LF) 



Finally a computation function 907 makes it possible to 
obtain a threshold value intended for use by external 
circuits to allow optimal inlaying of the synthetic 
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image thus processed into a video image originating 
from an outside source. 
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CLAIMS 

System for processing data for display on a matrix 
screen, of the type comprising a symbol generator 
(101) connected to an image memory (103) itself 
connected to a correlator (105) making it possible 
to implement a processing based on microregions so 
as to generate the final image to be displayed on 
a matrix screen (102), characterized in that the 
image memory (103) is organized so as to be able 
to read n pixels in parallel and in that the 
correlator (105) is organized so as to process 
these n pixels in parallel. 

System according to Claim 1, characterized in that 
the correlator is divided into two parts 
(3 03, 3 04) making it possible to process the 
luminance and the chrominance separately so as to 
make it possible to perform a hierarchical 
processing of the colours. 

System according to either of Claims 1 and 2, 
characterized in that it comprises means 
(305, 306) for separately processing the colour of 
the strokes and the colour of the background, and 
a mixer (307) for making it possible to outline 
the elements of scenery displayed on the 
background in tone on tone mode . 

System according to any one of Claims 1 to 3, 
characterized in that the correlator is organized 
in m substantially identical parallel lines making 
it possible for the m pixels of one of the axes of 
the microregions used to be processed in parallel. 
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Declaration and Power of Attorney for Patent Application 
Declaration et Pouvoirs pour Demande de Brevet 

French Language Declaration 



En tant I'inventeur nomme ci-apres, je declare par le 
present acte que: 



As a below named inventor, i hereby declare that. 



Mon domicile, mon adresse postale et ma nationality sont 
ceux figurant ci-dessous a cote de mon nom. 



My residence, post office address and citizenship are as 
stated next to my name. 



Je crois etre ie premier mventeur original et unique (si un 
seul nom est mentionne ci-dessous), ou Tun des premiers 
co-inventeurs onginaux (si piusieurs noms sont mentionnes 
ci-dessous) de i'objet revendique\ pour lequei une 
demande de brevet a ete deposee concernant ('invention 
intitulee 



ff ! et dont la description est fournie ci-joint a moins 
;|;| □ ci-joint 

□ a ete deposee le 



^ sous ie numero de demande des Etats-Unis ou le 
numero de demande international PCI 



. et modifiee Ie 
. (ie cas echeant). 



I believe I am the original, first and sole inventor (if only one 
name is listed below) or an original, first and joint inventor 
(if plural names are listed below) of the subject matter 
which is claimed and for which a patent is sought on the 
invention entitled 



SYSTEM FOR PROCESSING DATA FOR 
DISPLAY ON A MATRIX SCREEN 

the specification of which: 

□ is attached hereto. 

& was filed on May 5, 2000 



as United States Application Number or PCT 
International Application Number 

PCT/FR00/01232 and was amended on 
(if applicable). 



Je declare par le present acte avoir passe en revue et 
compris le contenu de la description ci-dessus, 
revendications comprises, telles que modifiees par toute 
modification dont il aura ete fait reference ci-dessus. 



I hereby state that I have reviewed and understand the 
contents of the above identified specification, including the 
claims, as amended by any amendment referred to above. 



Je reconnais devoir divulguer toute information pertinente a 
la brevetabilite, comme defini dans le Titre 37, § 1.56 du 
Code federal des reglementations. 



I acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of 
Federal Regulations, § 1.56. 



Page 1 of 3 



French Language Declaration 



Je revendique par le present acte avoir la prionte etrangere en 
vertu du Titre 35, § 119(a)-(d) ou § 365(b) du Code des Etats- 
Unis, sur toute demande etrangere de brevet ou certificat 
,d'inventeur ou, en vertu du Titre 35, § 365(a) du meme Code, sur 
toute demande Internationale PCT designant au moins un pays 
autre que les Etats-Unis et figurant ci-dessous et, en cochant la 
case, j'ai aussi mdique ci-dessous toute demande etrangere de 
brevet, tout certificat d'mventeur ou toute demande Internationale 
PCT ayant une date de depot precedant ceile de la demande a 
propos de laquelle une pnonte est revendiquee 



! hereby claim foreign priority under Title 35, United States Code, 
§ 1 19(a)-(d) or § 365(b) of any foreign apphcation(s) for patent or 
inventor's certificate, or § 365(a) of any PCT International 
application which designated at least one country other than the 
United States, listed below, and have also identified below, by 
checking the box, any foreign application for patent or inventor's 
certificate, or PCT International application having a filing date 
before that of the application on which priority is claimed 



Prior Foreign Appfication(s) 

Demande(s) de brevet anteneure(s) dans un autre pays 



9906000 



(Number) 
(Numero) 



(Number) 
(Numero) 



FRANCE 



(Country) 
(Pays) 



(Country) 
(Pays) 



11 MAY 1999 



(Day/Month/Year Filed) 
(Jour/Moss/Anne de depot) 



( Day/Month /Year Filed) 
(J our/Mo is/An ne de depot) 



Priority claimed 
Droit de pnonte 
revendique 



B 


n 


Yes 


No 


Oui 


Non 


□ 


□ 


Yes 


No 


Out 


Non 



Je revendique par le present acte tout benefice, en vertu du Titre 
i^, 35 - § 11 9(e) du Code des Etats-Unis, de toute demande de 
^brevet provisoire effectuee aux Etats-Unis et figurant ci-dessous 



I hereby claim the benefit under Title 35, United States Code, 
§ 119(e) of any United States provisional apphcation(s) listed 
below 



(Application No.) 
(N 2 de demande) 



(Filing Date) 
(Date de depot) 



(Application No.) 
(N 9 de demande) 



(Filing Date) 
(Date de depot) 



Nile revendique par le present acte tout benefice, en vertu du Titre 
?t '35, § 120 du Code des Etats-Unis, de toute demande de brevet 
effectuee aux Etats-Unis, ou en vertu du Titre 35. § 365(c) du 
r%neme Code, de toute demande Internationale PCT designant les 
j^- Etats-Unis et figurant ci-dessous et, dans la mesure ou I'objet de 
I ^chacune des revendications de cette demande de brevet n'est 
ftp as divulgue dans ia demande anterieure americaine ou 
Ulnternationale PCT, en vertu des dispositions du premier para- 
psgraphe du Titre 35, § 112 du Code des Etats-Unis, je reconnais 
'^devoir divulguer toute information pertinente a la brevetabilite 
Hcomme defini dans le Titre 37, § 1 56 du Code federal des 
reglementations, dont j'ai pu disposer entre la date de depot de 
la demande anterieure et la date de depot de la demande 
nationaie ou internationale PCT de ia presente demande. 



I hereby claim the benefit under Title 35, United States Code 
§ 120 of any United States application(s), or § 365(c) Of any PCT 
International application designating the United States, listed 

below and, insofar as the subject matter of each of the claims of 
this application is not disclosed in the prior United States or PCT 
International application in the manner provided by the first 
paragraph of Title 35, United States Code, § 1 12, I acknowledge 
the duty to disclose information which is material to patentability 
as defined in Title 37, Code of Federal Regulations, § 1 .56 which 
became available between the filing date of the prior application 
and the national or PCT International filing date of this 
application. 



PPT/FR 00/01 232 

(Application No.) 
(N Q de demande) 



may ^ ?nnn 

{Filing Date) 
(Date de depot) 



(Status) (patented, pending, abandoned) 
(Statut) (brevete, en cours d'examen, abandonne) 



(Application No.) 
(N 9 de demande) 



(Filing Date) 
(Date de depot) 



Je declare par le present acte que toute declaration ci-incluse 
est, a ma connaissance, veridique et que toute declaration 
formuiee a partir de renseignements ou de suppositions est 
tenue pour veridique, et de plus, que toutes ces declarations ont 
ete formulees en sachant que toute fausse declaration volontaire 
ou son equivalent est passible d'une amende ou d' une 
incarceration, ou des deux, en vertu de la Section 1001 du Titre 
18 du Code des Etats-Unis, et que de telles declarations 
volontairement fausses risquent de compromettre la validite de la 

demande de brevet ou du brevet delivre a partir de celle-ci 



(Status) (patented, pending, abandoned) 
(Statut) (brevete, en cours d'examen, abandonne) 

I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may 

jeopardize the validity of the application or any patent issued 

thereon 
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French Language Declaration 



POUVOIRS: En tant que i'inventeur cite, je designe par la 
presente l'(les) avocat(s) et/ou agent(s) sutvant(s) pour qu'ils 
poursutve(nt) la procedure de cette demande de brevet et 
traite(nt) toute affaire s'y rapportant avec I'Office des brevets 
et des marquees, (mentionner le nom et le numero 
d 'enregistrement) 



POWER OF ATTORNEY: As a named inventor, i hereby 
appoint the following attorney(s) and/or agent(s) to prosecute 
this application and transact all business in the Patent and 
Trademark Office connected therewith, (list name and 
registration number) 



Norman F. Obion, Reg. No^2A£X8; Marvin J. Spivak, Reg. No. 24^91^ C. Irvin McClelland, Reg. No. 2±*12lLGregory J. Maier, Reg. No. 

Arthur I. Neustadt, Reg. No. 24,854; Richard D. Kelly, Reg. No 27 J3T, James D. Hamilton, Reg. No. 28,421 ; Eckhard H. Kuesters, 
Reg. No._2RjBZ0; Robert T. Pous, Reg. No 29^099; Charles L. Gholz, Reg. No. 26,395; William E. Beaumont, Reg. No. 30^996; Jean-Paul 
Lavatleye, Reg. No. 3JL4.&U- Stephen G. Baxter, Reg. No 32J384; Richard L/Treanor, Reg. No 36^379; Steven R Weihrouch, Reg No. 
32J29; John T. Goolkasian, Reg. No. 26J42^Rtchard L. Chinn, Reg. No., 34^0,5, Steven E. Upman, Reg. No. 30,011; Carl E. Schlier, Reg. 
No. 34 J 426;.James J. Kulbaski, Reg. No. 34J48; Richard A. Neifeld, Reg. No. 35,299; J. Derek Mason, Reg. No. ,35,270; Sunnder Sachar, 
Reg. No. .34,423-; Christina M. Gadiano, Reg. No. 3Z.628; Jeffrey B. Mclntyre, Reg. No William T. Enos, Reg. No,„33J!28; Michael E. 

McCabe, Jr., Reg No. 37 7 lS2^Bradiey D Lytle, Reg. No. „4.QJ2Z&~and Michael R. Casey, Reg. No v iK1^94rWtth full powers of substitution and 
revocation. 



Addresser toute correspondance a. 



Send Correspondence to: 
Oblon, Spivak, McClelland ^Ma£^_& Kesusxapt, P.C. 

„ — „. — TCTTJRTH FLOOR 

1755 JEFFERSON DAVIS HIGHWAY 
ARLI NGTON f VI RG I NIA 22202 USA 



5' Adresser tout appel telephonique a. 
RJ (nom et numero de telephone) 



Direct Telephone calls to- (name and telephone number) 
(703)413-3000 



Nom complete de Tunique ou premier inventeur 


Full name of sole or first inventor * 
..j^n-J^3H^^,l[^V0]_ October 22, 2001 


Signature de I'inventeur Date 


Inventor's signature Date 


Domicile 


Residence 

33127 M ARJLGM J ALL E 5 FRANCE 


Nationalite 


C itizenshi p ~ /~ ' , ' 
French 


Adresse Postaie 


Post Office Address 
13, allee des Grives 




33127 MARTIGNAS EN JALLES FRANCE 


Nom complete du second co-mventeur, le cas echeant 


Full name of second joint inventor, if any 
Jean-Christophe ABADIE October 22, 2001 


Signature de I'inventeur Date 


Second inventor's signature ^/^Sate 


Domicile 


Residence 

33380 BIGANOS FRANCE 


Nationalite 


Citizenship 
French 


Adresse Postaie 


Post Office Address , , { 
86; rue Georges Clemenceau * 6 / ' 




33380 BIGANOS FRANCE 



(Fournier les memes renseignements et ia signature de tout (Supply similar information and signature for third and subsequent 

co-inventeur supplemental^ ) joint inventors ) 
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